THE STABILITY OF JOIN-THE-SHORTEST-QUEUE MODELS 
WITH GENERAL INPUT AND OUTPUT PROCESSES 



VYACHESLAV M. ABRAMOV 



Abstract. The paper establishes necessary and sufficient conditions for 
stability of different join-the-shortest-queue models including load-balanced 
networks with general input and output processes, ft is shown, that the 
necessary and sufficient condition for stability of load-balanced networks 
is associated with the solution of a linear programming problem precisely 
formulated in the paper. It is proved, that if the minimum of the objec- 
tive function of that linear programming problem is less than I, then the 
associated load-balanced network is stable. 
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1. Introduction 

1.1. The goal of the paper. The theory of parallel queues is a distinguished 
area of queueing theory. Parallel queues have good properties (e.g. Halfin [28] . 
Mitzenmacher [33], Winston [55]) resulting in various applications in different 
areas of science and technology. The literature on parallel queues is very rich 
and includes solutions of a large number of various theoretical and applied prob- 
lems. In this context we mention the pioneering paper of Flatto and McKean 
[20] . the papers of Flatto [18] ; Flatto and Hahn [19], as well as the recent paper 
of Kurkova and Suhov [M] for mentioning a few. 

During the last years there has been increasing interest in parallel queueing 
systems due to a growing development of telecommunication technologies. As 
a result, there has been substantially increasing number of related publications 
including such areas as routing and admission control problems, scheduling and 
many other areas using the join-the-shortest-queue (JS-queue) policy. 

Despite of many existing publications on JS-queue models, it is still not a 
well-studied area. There is a large number of unsolved problems or problems the 
solution of which is very far from its completion. One of them is a problem of 
stability. The stability (instability) of different JS-queue (together with stability 
other closely related models) has been studied in many papers. We refer to the 
papers of Foley and McDonald [21], Foss and Chernova [22], [23], Kurkova 
[33], Sharifnia [IE], Suhov and Vvedenskaya 51j, Tandra, Hemachandra and 
Manjunath [52], Vvedenskaya and Suhov [M], and Vvedenskaya, Dobrushin 
and Karpelevich [53J. Particularly, the stability of a Markovian load-balanced 
network, consisting of two stations only, has been studied in |33j. 

In the present paper, we establish necessary and sufficient conditions of sta- 
bility for a wide class of load-balanced networks, the arrival and departure 
processes of which are assumed to be quite general. The exact description of 
these processes will be provided later in the paper. 

1.2. Motivation. The stability of stochastic processes and especially queueing 
systems and networks of queues is a very significant area of research. The first 
results on the stability of queues go back to the well-known pioneering papers of 
Lindley [35] and Kiefer and Wolfowitz [31] on the stability of classic single-server 
and multiserver queueing systems. One of the most significant contribution to 
stability of queueing systems was made slightly later by Loynes [36], who was 
the first person to establish the stability of single-server queues with dependent 
inter arrival and service times. The approach of Loynes [36] is well-known and 
has been widely used to prove the stability of various queueing systems. It led 
to a new vision of the stability for models with dependent interarrival and/or 
service times, and has been a source for new methods of the stability of complex 
queueing models. Among them there are renovative theory and recurrence 
equation methods (e.g. [5], [6], [7], [HJ, [II]; 03] > 02] > [21] and many others) as 
well ELS £1 martingale-based approach of [3]. 

However, the development of the Loynes approach towards queueing net- 
works, because of their complicated nature, has been problematical, and the 
proof of the stability and ergodicity of queueing networks is typically based 
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on other methods based on the special theories of Markov and regeneration 
processes. 

The first results on the stability of Jackson-type queueing networks have 
been obtained by Borovkov [12], [13]. Then the stability and ergodicity of 
networks have been studied in many papers. We mention the papers related 
to the stability of Jackson-type networks by Meyn and Down [38], Kaspi and 
Mandelbaum [29], [30], Sigman [19] and Baccelli and Foss [9]. All of these 
papers, but [9], are based on regeneration phenomena of the theory of Harris 
recurrent Markov chains. 

The theory of Harris recurrent Markov chains had been exposed in the books 
of Orey [H] and Revuz [36] . The detailed study of stochastic stability of Markov 
chains and the theory of Harris recurrent Markov processes can be found in the 
book of Meyn and Tweedie [12], and in a number of research papers of these 
authors (55]. [10] and [51]. 

However, the proof of networks stability by the means of Harris recurrent 
Markov chains is restrictive. Being very difficult technically, it works in the cases 
where the sequences of interarrival and service times consist of independent 
random variables. In this case the phase space of the process can be expanded 
to Markov, and a network stability is proved in terms of the stability of the 
corresponding Markov process. As a rule the proof of the network stability in 
this case requires specific additional conditions. For example, in most of papers 
an infinite support of interarrival time distributions is required. Sometimes 
some additional method based technical conditions are required as well (e.g. 
see Dai [16]). 

Baccelli and Foss [9] proved the stability of Jackson-type networks with de- 
pendent interarrival and service times. Their proof is based on development 
of renovation theory. However, the mentioned paper is about 70 pages long, 
it contain many notions and results from different areas of research (stochastic 
Petri nets for example), and it is not easy to read this paper. 

In the present paper, we establish conditions for stability of JS-queue mod- 
els including load balanced networks. The class of load-balanced networks is 
wider that the class of Jackson-type networks, so the stability results of the 
present paper are more general than those for Jackson-type networks. On the 
other hand, our method is a Loynes-based method, and our stability results are 
established for quite general networks with sequences of dependent interarrival 
and service times, and these sequences can be dependent of one another as 
well. Furthermore, for the known cases of queues and networks our results are 
obtained under weaker conditions than known results. For example, the paper 
of Baccelli and Foss [9] requires stationarity of the appropriate sequences of 
interarrival and service times. In our case, we requires weaker conditions of the 
strong law of large numbers, and our class of systems is therefore wider. 

Our challenge is as follows. We first establish the following equivalence: the 
stability of usual queueing systems follows from the stability of queueing systems 
with autonomous service mechanism (which are sometimes called queueing sys- 
tems with a walking type service |27] ) . This result is based on sample path anal- 
ysis and stochastic comparison, and although its proof is elementary, the result 
is a significant contribution to the proof of the stability of different queueing 
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networks. Sample-path analysis for stability of queueing systems and networks 
is not new (e.g. [32]). However, the approach of the present paper specifically 
uses a sample-path analysis in combination with other methods and based on 
the new idea of reduction of the original problem to another not traditional 
simpler problem. 

The aforementioned stochastic inequalities established for queueing systems 
is easily extended to each node of a network, where a stable behavior of each 
node of a usual network is a consequence of the stable behavior of the corre- 
sponding node of the queueing network with autonomous service mechanism. 
Then the general problem reduces to the easier problem of the stability of net- 
works with autonomous service, and the second part of the proof is to establish 
the stability of queueing networks with an autonomous service mechanism. This 
second part of the proof is based on the Loynes method. 

Queueing systems with an autonomous service mechanism have been intro- 
duced and initially studied by Borovkov [ID], [II], and then have been an object 
of study in a large number of papers (e.g. [I], [2], [25], [26], [27]). In traditional 
applications, queueing systems with autonomous service are associated with a 
shuttle bus picking up passengers from stations. Other, more interesting appli- 
cations of these systems, are known from computer technologies. One of such 
examples is the event processing in the operating system Microsoft Windows. 
The details of this issue can be found in |45] in Section 10: Threads Synchro- 
nization and specifically on page 396 (Events). The original construction there 
is much more complicated than that in our example described below, and it 
is explained in terms of threads and their synchronization which is required in 
the Windows programming. However, loosely speaking, it can be explained as 
follows. In specified time instants, the event processor checks whether there 
is an event (such as mouse- movement, mouse-click, mouse-double-click and so 
on) in the event queue. If such an event exists (there is a thread receiving an 
acknowledgement (signal) about it), then the system processes it at specified 
time instant. Otherwise, the system continues to check the state of the event 
queue. 

The idea of reducing one stability problem of a complex network to another 
corresponding stability problem of a network with simpler /concise properties 
is not new. There are special criteria in the literature allowing to replace an 
original (stochastic) network by its (deterministic) fluid model to study the 
stability. Such criteria for quite general class of queueing networks with multiple 
customer classes has been established by Dai [16] , Formally it had been used 
before for establishing the instability of a special configuration of a network 
with priority classes by Rybko and Stolyar |47j . 

Although the reducing an original stochastic network to its deterministic fluid 
analogue looks natural, in fact it requires additional (mild) conditions. In the 
case of our study by reducing an original stochastic network to its associated 
stochastic network with autonomous service mechanism no additional condition 
is required. 

1.3. Organization of the paper. The rest of the paper is organized as fol- 
lows. In Section 2 we describe the main JS-queue models, which will be then 
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developed and modified in the following sections. (The material of the paper is 
presented in the order of increasing complexity.) In the same section we give all 
of the necessary definitions related to stability of queues and networks. In Sec- 
tion 3 we prove the correspondence between the stability of the original queueing 
system and that of the associated queueing system with an autonomous service 
mechanism. The proof is based on sample path analysis. In Section 4 we estab- 
lish conditions for stability of JS-queue models of queueing systems, and then 
in Section 5 we establish conditions for stability of load-balanced networks. In 
Section 6 we conclude the paper, where the stability of more general networks, 
than those studied here, with batch arrival and service times are discussed. 

2. Description of the main models and definitions of stability 

2.1. Main models. In this section we describe main JS-queue models with an 
autonomous service mechanism. These models and some of the assumptions 
related to the arrival and departure processes will be then modified in the 
following sections. 

• There are m identical servers, each of which having its own queue. 

• All of the processes that describe queueing models are assumed to be right- 
continuous and to have left limits. 

• The arrival process is governed by two point processes A(t) and A'(t). The 
process A(t) is defined by sequence {r n } n >i of positive random variables, and 
the corresponding sequence of points is the following: t\ = t±, and t n+ \ = 



t n + T n+ i, n > 1. Then, A(t) = Y^i^-{ti<t}- The process A'(t) is defined 
analogously. We have the sequence of positive random variables {r^} n >i, and 
the sequence of points t[ = r{, and t' n+1 = t' n + r' n+l ,n > 1. Then, A'(t) = 
E*=i 1 {t' i <t}- We assume 



The process A(t) forms a dedicated traffic, while the process A'{t) forms an 
opportunistic traffic. 

• A customer arriving at moment t n , n > 1, is assigned to the jth queue, 
j = 1,2, ... ,m, with the probability pj Q^jliPj = 1)) residing there to wait 
for the service. 

• A customer, arriving at moment t' n , n > 1, is assigned to the queue with 
the shortest queue-length breaking ties at random. 

• The departure process from the j'th server is governed by the point process 
D^\t). Specifically, the nth service time of the j'th server is denoted xi\ and 
the corresponding sequence of points is denoted {x[ J '} where x^p = xP an d 
x^n+i = x$ + Xn+i) n> 1. We assume 
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• For our convenience we assume that the processes A(t), A'(t) and D^\t), 
j = 1,2, ... ,m, all are mutually independent point processes. (Then this con- 
dition together with other conditions ({2.1]) . (|2.2|) and (|2.3p will be relaxed.) 

• The service mechanism of each server is assumed to be autonomous. This 
means the following. Let QW'{t) denote the number of customers in the jth 
queue at time t, j = 1, 2, . . . , m, and let Q^(0) = 0. Let A® (t) and A'^\t) 
denote the thinning of the processes A(t) and A'(t) respectively, where A^(t) 
and A'ti)(t) are arrival processes to the jth queue. Then, 

Q®{t) = A®{t) + A'W(t) - f l {QU){s _ >0} dD^(s). (2.4) 

J 

For the further convenience the above model is denoted p m , where the subscript 
m denotes the number of parallel queues. 

The model p m is a special case of the more general model, in which it is 
assumed that there are m different arrival point processes A^'(t), A^(t),. . . , 
A^ (t) of dedicated traffic corresponding to m servers. Let us denote this more 
general model T m . 

In turn, we will also consider the particular case of the model p m , where 

1 

Pi = P2 = ■ ■ ■ = Pm = — • 

m 

In this case the families {A^\t)}j< m and {A'^\t)}j< m consist of identically 
distributed processes. The above symmetric model with m parallel queues is 
denoted S m . 

2.2. Definitions of stability. For the sake of convenience we discuss defini- 
tions for p m models. The extension of this definition to models T m is technical. 
The above equation for model p m is given for all t > 0. For our purpose we 
extend this equation, assuming that all the processes start at a. Then, instead 
of (|2.4p we have the following equation: 

Q<p(t)=A®(t)+4®(t)- j\ {Q u ){s _ )>0} dD^(s), (2.5) 

where the subscript a says that the processes start at a. 
Definition 2.1. The system p m is called to be instable if 

lim P{Qi jo) (t) e = 

— oo 

for any bounded set .5^ at least for some index jo and any t. Otherwise, the 
system is called to be stable. 

Then, the stability of the system means the following 

Definition 2.2. The system p m is said to be stable if there exists a bounded 
set y such that 

limsupP{Q^(t) 6 y} > 

— oo 

for all j = 1, 2, . . . , m and any t. 
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This definition remains in force for all of JS-queue models included load- 
balanced networks considered in the paper. 

In some examples, the processes all are assumed to start at zero. In this case 
by the stability of the system p m we mean the existence of a bounded set 5? 
such that 

limsupP{Q ( %) E ^} > 

t— >oo 

for all j = 1, 2, . . . , m. 

3. Sample-path comparison of queueing systems 

In this section we compare three different queueing systems given on the 
same probability space (Q, P) and therefore defined by the same governing 
sequences of random variables, but different specific rules of departure. For the 
sake of simplicity we assume that all of these three systems start at zero with 
empty queue. 

These systems are defined by an arrival point process A(t) and departure 
process D(t). These processes are defined by the corresponding governing se- 
quences {r n } and {x n }- Let t k = n + r 2 + . . . + T k and x k = xi + X2 + • • • + Xk- 
Then, the point processes A(t) and D(t) are 

oo oo 

A(t) = J2 1 {t i < t} , D{t)= £)i {!Bi < t} . 

i=l i=l 

The first queueing system is the queueing system with autonomous service, 
which is denoted £H\. The queue- length process for this system is defined as 

Qi(t)=A(t)- f l {Ol(a _ )>0} dD(s). 
J o 

The second queueing system is the usual queueing system. Denote this sys- 
tem i?2, and the queue-length process of this queueing system Q2{t) is defined 
by the traditional recurrence equations well-known from the queueing theory. 
Specifically, following [10], p. 19, the queue-length process Q2(t) is defined by in- 
terrupted governing sequences as follows. Denoting rji = inf{k : t\ + x k < t k+ i} 
we have the following relations for the queue- length process Q2(t). For < t < 
ii, we have Q2(t) = 0, and for t\ < t < t± + x m , the queue-length Q2(t) is the 
difference between the number of arrivals and service completions during the in- 
terval [ti,t] including the arrival at the instant t\. Then, for t\ +x Vl < t < t ni+ \ 
we have Q2(t) = 0. Next, denoting r\2 = inf{/c > rji : t m+ i + x k — x m < t k+ i}, 
then for t m+ i < t < t m+ i the queue-length Q2(t) is the difference between the 
number of arrivals and service completions during the interval [t m+ i,t) includ- 
ing the arrival at the instant t m +i. The stopping times 773, 774, ... are defined 
similarly. 

The third queueing system is a special queueing system with delayed de- 
partures is denoted £2%. The queue-length process of this system is defined as 
follows. The arrival process A(t) is the same as in the systems £}\ (or ^2), 
but departures of the customers are delayed as follows. The instant of first 
departure is xi + X2-, the instant of the second departure is xi + X2 + X3 an d 
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so on. The departures occur only if there is at least one customer in the sys- 
tem. Thus, the difference between queueing systems =©i and £2 3 is only that 
the departures of customers in Q\ occur immediately at the above specified 
time instants, while in the queueing system ^3 these specified time instants 
are service begins until the next specified instants correspondingly (provided 
that the system ^3 is not empty) . The duration of these service times are 
Xi for the first customer, \2 for the second one, and so on. The queue-length 
process Q${t) is defined as follows. Let uja{P) denote the event, that the last 
arrival before time t was to an empty system and before time t (excluding the 
time instant t itself) its service has not yet been started, and 1^^) denotes the 
indicator of the event w^(t). Then, 

Q 3 (t) = A(t) - f\l - l WA(s) )l {Q3(s _ )>0} d J D( s ). (3.1) 
Jo 

According to (|3.ip . the process Q 3 (t) is always incremented at the moments 
of arrivals ti, i > 1. However, it is decremented as follows. Let tj be such a 
moment of arrival to an empty system (that is Q 3 {tj) = 1), and let i = min{j : 
ti < Xj}. Then at the moment xg the queue-length is not decremented, i.e. 
Qzipi) = Qziti)- In all of other points Xj where the queue- length is positive 
and do not satisfy the above property, the queue-length is decremented. 

Since all of the queue-length processes are defined on the same probability 
space, then these processes are provided by the additional argument u € f2 in 
the places where it is required. 

Proposition 3.1. 

Q2(t,u)<Q 3 (t,u). (3.2) 

Proof. Using sample path analysis we prove this proposition as follows. In the 
system ^3 we do not consider the events {Q 3 (xj — ) = 0} and uiA{t), taking into 
account service completions during busy periods only. According to this note, 
the points {xj} are to be renumbered such that there is the correspondence of 
such the points between the systems ^3 and J?2 in busy periods for the purpose 
of further sample path analysis. Then it is easily seen that the statement of 
the proposition follows, because in <£?2 the first service begin in a busy period 
coincides with the moment of arrival, while in J?3 it starts with delay, resulting 
in (Q. □ 

Proposition 3.2. 

Q 3 {t,u) -Qi(t,w) < 1. (3.3) 

Proof. For the purpose of the proof we will follow up the sample paths of the 
both processes of the queueing systems and £2 3 . 

Apparently, that Q\(t,oS) = Q%{t,uj) = for all t € [0,ii) (recall that ac- 
cording to convention A(0) = D(0) = 0). For the system let 

I = inf {i : Xi > ti} . 

Then, for any t from the interval [t±,xi) we have Qi(t,u) = Q 3 (t,u) = A(t, u>), 
while in the point x\ itself we have Q 3 (xi,u) — Q\(xi,lu) = 1, see Figure 1 (a). 
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G3« 

Coinciding Q { (t) and Q 3 (t) 



Figure 1. Typical sample paths of the queue- length processes 
Qi(t) and Q 3 (t): 

(a) Sample paths of the queue-length processes after the origin; 

(b) Sample paths of the queue-length processes before approach- 
ing zero at point x v . 
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Let v be a new number greater than I satisfying the property 

v = inf {k > I : Qi(x k -) = 0} . 

(If such a number does not exist, then v equates to infinity. In this case, 
obviously, Q^(t,u) — Q\{t,oS) = 1, t > xi.) Then for all t of the interval 
[xi, x v ) we have Qz{t, u) — Q\{t, uj) = 1, while in the point x v itself we arrive at 
Qi(x v ,u) = Q 3 (x v ,uj) = 0, see Figure 1 (b). 

Thus, we arrived at zeroth queue-lengths again. The further paths of the 
both processes after point t = x v behave similarly to those after the point 
t = 0, i.e. the difference Qz{t, uj) — Qi(t, uj) can take only one of the two values 
or 1. □ 

From Propositions 13.11 and 13.21 we arrive at the following conclusion: if the 
queueing system J2\ is stable, then the both queueing systems £?2 and are 
stable as well. Following Proposition 13.11 this statement of stability can be 
extended for more complicated constructions including two, three and more 
different arrival processes and can be then applied to queueing networks. 



4. Stability of JS-queues 

In this section we study stability of JS-queues. We start from the sim- 
plest CciSG of symmetric S m queues. Denote D a (t) = £™ =1 ^(i). In The- 
orem below, the assumption that the processes A(t), A'(t) and D^\t), 
j = 1,2, ... ,m, all are mutually independent point processes is relaxed. For 
S m queues where pj = ^, j = 1, 2, . . . , m, instead of (|2.ip . (|2.2p and (|2.3p we 
assume 

r Km Mi) + KM-DJ.i) =x + x ,_ 1 =1 . (41) 

[a^ -oo t — a J 

Theorem 4.1. In addition to (14. ip assume that 

lim P{A a (t)+A' a (t)-D a (t)e^} = (4.2) 

— oo 

for any bounded set . Then, the system S m is stable if and only if the condi- 
tion ^ + ^ < /i is fulfilled. 

Proof. Since the families {Aa\t)}j< rn and {Da\t)}j< m consist of identically 

distributed processes, then the family {A'^\t)}j < m also consists of identi- 
cally distributed processes, and according to (|2.4p the family of the processes 

{Qa \t)}j<m consists of identically distributed processes too. Observe that 
from (|4.2|) . because the system S m is symmetric, we also have 

lim P{A^(t)+A'^(t)-D^(t)ey} = (4.3) 

— oo 

for all j = 1, 2, . . . , m. 

Notice, that if ^ + ^ < fi, then 

P{ sup [A®(t)+A$»{t) 

*■ a<t<oo 



-Z#)(t)] <«,} = !. (4.4) 
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Indeed, according to (|4.ip . P-a.s. 

]im ^ W + ^W-^'w = A + y 

-oo i — a mm 

Hence, P-a.s. 

lim [A® (t)+ A™ (t)-Djp $)] = -*>, 

— oo 

and fOD follows from the fact that and Z)^(i) all are cadlag 

processes. 

Next, taking into account (03J and ^i j) (a) = X (j) (a) = D { P{a) = 0, for the 
queue-length process Q^'(t) one can write the following representation: 

QW(t) = [iW(i)+i'W(t)-DW(t)]- ini ' [^)(t)+^W(t)-2?C0( f) ]. (4.6) 

a<s<t 

Representation (14. 6p is well-known (e.g. Borovkov [TO]) and is a consequence 
from the Skorokhod reflection principle (e.g. Kogan and Liptser [32] for typical 
application to queue- length processes). 
Next, from (|4.6[) we have: 

Qf {t) I sup { [A^ (t) + A® {t) - Dip it)] 

a<s<t 

-[aP(s) + AM( S )-DP(s))}. (4.7) 

From representation (14. 7p . relation (14. 4p and the fact that all of the processes 
Aa\t), Xa\t) and Da (t) are cadlag processes, it follows that there exists a 
bounded set =5^0 such that 

limsu P P{Q^(i) G ^0} > 0, 

—00 

and the sufficient condition is therefore proved. The necessary condition follows 
from the fact that (14. 3p together with (|4.4p imply the condition ^ + ^ < /i. □ 

Remark 4.2. If — + — = fi, and the processes A(t), A'(t) and -D(i) all are non- 
trivial renewal processes, then we easily arrive at condition (|4.2p . However, 
there are examples where — + — = fi, but condition (|4.2p is not fulfilled. 
Indeed, let t\ + t{ — xi be a uniformly distributed random variable in [—6,6], 
(6 > 0), and let Tj+i + r 4 ' +1 — x«+i = — (j% + 7"/ — Xi)) > 1- In this case (|4.2p is 
not valid. Therefore condition (|4.2p is meaningful. 



Remark 4.3. The conditions of Theorem l4.1l are weaker than conditions of other 
known stability theorems (e.g. Borovkov |10| ) requiring the strict stationarity 
and ergodicity of appropriate sequence of random variables. For example, as- 
sume that the sequence {T n +r' n — % n }n>i consists of identically distributed ran- 
dom variables, T\ +t[ — xi is a uniformly distributed random variable in [—6, 6], 
(6 > 0), andr 2 +r^-X2 = n+^-Xi, and T i+1 + r' i+l - Xi+i = -{n+T^-Xi), 
i > 2. Then the above sequence {r n + r' n — Xn}n>i is not strictly stationary. 
However, the queueing system associated with this sequence is stable. 

For following Theorem 14.41 our assumptions regarding the point processes 
A a (t), Da {t) is as follows. For dependent processes A a (t), Da \t) we suppose 
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that the normalized processes 4^jr anc ^ D 't-a' > converge, as a — > — oo, to the 
corresponding limits A and /J, only in distribution, while 

I -oo t — a 

Then, the process A' a (t) is assumed to satisfy the condition 

lim = A = l. (4.9) 

a^r — oo t — a J 

Next Theorem 14.41 is related to stability of p m queues. Denote A,- = Xpj 



j* = argmaxi<j< m Xj and A = YT=ii^j* ~ -\?)- 



.(A - A:). 

Theorem 4.4. In addition to (|4.8p and ()4.9[) assume that both 

lim P{A,(t)+^(t)-I>a(t)€^} = J (4.10) 

— oo 

and 

lim P{4>'*>(t) - e ^} = (4.11) 

a— » — oo 

/or any bounded set 5? . Then the system is stable if and only if one of the 
following two conditions is fulfilled: 

!>'*>< m, */ A > A', 
I A + A' < m/x, otherwise. 

Proof. The theorem can be proved by a slight modification of the earlier proof. 

Suppose first that A > A', and denote qj the fraction of customer of the 
opportunistic traffic being assigned to the jth queue. From the limiting relations 

Bm ^ I Aj, 

-oo t — a 

lim ^' A', 

a-^ -oo t — a 

according to well-known Skorokhod's theorem [50], p. 281, one can conclude 
that there exists a probability space (Q,^, P), with given there a family of 

processes | Aa ih^^As — > a| such that for P— almost all a; G O, 

-oo t — a 

Therefore, from the balance equations 

Aj + Aj- = Aj + X'qj = g, 
one can conclude that qj* must be equal to 0. Therefore 

Xj* > Xj + A^ 
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for all j = 1,2, ... ,m, where A^ = X'qj. Then, in this probability space for P— 
almost all u € O, 

hm < hm , 

a— » — oo t — a — oo t — a 

and, from (12.50 and coupling arguments of sample paths comparison 

r Q%\t,U>) QT\t,U>) 

hm < hm . 

-oo t — a -oo t — a 

Therefore, in the original probability space we have 

Urn dgWgW | Km ^2W 

-oo t — a -oo t — CL 

and consequently, 

lim g^w < Hm ^2w 

ct^ -oo t — a a-* -oo t — a 

for all j = 1, 2, . . . , m. Hence the problem reduces to conditions of stability of 
a single queueing system with autonomous service mechanism with the given 
arrival process A^*\t) and departure process Dv\t), and under assumptions 
(|4.8p and (|4.1ip the necessary and sufficient condition of stability is given by 
\j* < [i. 

Let us now consider the opposite case A < A' and assumption A + A' < \im. 
Then, there exist probabilities qj, j = 1,2, ...,m, all strictly positive, and 
YlJLi Qj = 1- Under these probabilities, the opportunistic traffic is thinned into 
m processes such that almost surely 

1- X' V 

hm = A qj = A,-. 

-oo t — a J 

Indeed, since A + A' < fj,m, then there exists the value g = < n such 
that for all j 

Q > \j, 

and therefore, 

gj = ^ > 0. (4.12) 

Since Xj + qj\ f = g, the family <Aa\t) +Aa(t)\ consists of processes 
having the same rate, i.e. 

a— » — oo t — CL 

The possible values {qj}j< m are unique, since otherwise, if there are different 
arrival rates A,- + A'g'-, then one of queues must be stochastically longer than 
other. Let j* be the order number of the longer queue. Then qj* should be 
equal to 0, and we have the contradiction with (|4.12p . 

According to (|4.13p for each of m queue-length processes the arrival rate is 
the same. With the same arrival and departure intensities one can repeat the 
proof of Theorem 14.11 for each queue-length process. Therefore, g < \i is the 
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condition for stability, and under condition (|4.10p the system is stable if and 
only if q < /j,. The theorem is proved. □ 

Remark 4.5. In the case of the model T m the following additional comments 
are necessary. If the value j* is not unique, then condition (|4.1ip should be 
assumed for all j*. In addition, instead of condition (|4.8p we should require 



P { lim &m-m) = , 1 . 

I -oo t — a 1 

for all j = 1,2, ... ,m, and in addition we should require the convergence of 

A^(t) D^(t) 

the normalized processes and , as a — > — oo, to the corresponding 

numbers Xj and fi in distribution. 



5. Load-balanced networks and their stability 

In the previous section, the necessary and sufficient conditions for stability 
of systems p m have been established. In this section we extend above Theorem 
14.41 for load-balanced networks associated with p m queueing systems. The main 
result of this section is Theorem 15.31 establishing the necessary and sufficient 
condition for the stability of load-balanced networks. Theorems 15.11 and 15 . 2 1 are 
the preliminary results establishing only sufficient conditions for the stability. 

The load-balanced network considered below is the following extension of the 
p m queueing system. 

Assume that an arriving customer of the dedicated traffic occupies the server 
j with probability pj (j = 1,2,... ,m), and Y^jLiPj = 1- After his service 
completion in the jth queue, a customer leaves the system with probability 
1—Pj, remains at the same jth queue with probability pjj , goes to the different 
queue i ^ j with probability pjj, and choose the shortest queue with probability 
Pj t shi breaking ties at random. It is assumed that p*j < 1 at least for one of the 
indexes j. This model is called load-balanced network. The stability conditions 
of the Markovian variant of this network containing two stations only has been 
established by Kurkova [33J . 

Some different variants of this network have also been studied in Martin and 
Suhov [37], Vvedenskaya Dobrushin and Karpelevich 53J and other papers. 

Denote Xj = Xpj, Aj = Xj + (J-YliLiPiji 3* = argmaxi<j< m Aj. 

For the sake of simplification of the proofs, we follow the assumptions that 
are described in Section 2, with understanding that they can be relaxed by the 
way of the previous section. We also assume that the processes all are started at 
a and use the variants of the assumptions where a — > —oo rather than t — > oo. 

The sufficient condition given in Theorem 15.11 is a straightforward extension 
of earlier Theorem 14.41 written now in a simpler form. 

Theorem 5.1. Assume that Xj* > Aj for all j ^ j* . Denote 

m 
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and 

A 2 = ^(A r -A i ). 

3 ¥"3* 

Then the load-balanced network is stable if one of the following two conditions 
is fulfilled: 

jAj» < /z, if A 2 > A' + /J,T,jLiPj,sh, 

+ X + ti\Y^iY%LiPi,j + TJjLiPj,sh) <mfj,, i/Ai<A'. 

Proof. The proof of the theorem starts from the case Pj lS h = for all j = 
1,2, ... , to and then discusses the case Pj >s h > for all j = 1, 2, . . . , m. 

Let us start from the case where Pj :S h = for all j = 1, 2, ... ,m. Then, 
the system of equations for the queue-length processes started at t = a can be 
written 

gW( t ) = 4%) + 4ffl(t) + s a W( t ) - jf* i {Q y )(s _ )>o} d^')( s ), (5.i) 

where the new process Ea\t) presenting in (|5.ip is a process, generated by 
internal dedicated arrivals to the jth queue. By internal dedicated arrivals 
to the jth queue we mean internal arrivals of the customers, who after their 
service completion in one or other queue are assigned to the jth queue. Recall 
that there is probability pij to be assigned from the queue i to the queue j. 
Relationship (|5.1j) is of the same type as that (|2.5I) . and therefore all of the 
arguments of the earlier proof of Theorem 14.41 can be repeated. Specifically, in 
the case A 2 > A' the system is stable if Aj* < /j,. 

In turn, the process can be represented as YliLi Ea (t), where the 

point process E^ (t) is generated by the customers who are assigned to the 
jth queue after their service completion in the ith queue (in the case i = j it is 
assumed that the customers decide to stay at the same queue). Notice, that 

r E^jt) 
hm 

a-^ — oo t — a 

does exist with probability 1 (because the process Eyi (t) is generated by the 
procedure of thinning of the departure process D$(t)), and 

lim I 1 ; < m ,j \ = 1, (5.2) 
-+ -oo t — a ) 

where the equality holds only in the case where the fraction of the zth queue 
idle period vanishes as a — » — oo. Therefore under the condition Ai < A' the 
system is stable if A + A' + fj, J2iLi Y^jLiPhj < m l l - 

Assume now that Pj tS h > for all j = 1,2, ... ,m. Then instead of (15. ip we 
have the equation 

QW(t) = A^(t) + A'P(t) + E®(t) + E'^(t) 

/"* r , (5-3) 

-J \Q«\s- >0} dD ^ 
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where E'^\t) are the point processes associated with internal opportunistic 
traffic to the jth queue. By internal opportunistic traffic we mean the internal 
traffic of customers presenting in the queue, who after their service completion 
decide to join the shortest queue. In the case where the shortest queue is the 
jth queue, we say about opportunistic traffic to the jth queue. Again, 

— oo t — a 

does exist with probability 1 (because the process E$\t) is generated by the 
procedure of thinning of the departure process Da\t)), and similarly to (|5.2p 
we have: 

Hm () </*x>i.4 = i - ( 5 - 4 ) 

-oo t — a ^-^ I 

3=1 J 

Therefore, the entire opportunistic traffic to the jth queue, being a sum of the 
processes A'£*\t) and i?a (i), satisfies 

r T,7=^\t)+E^(t)] - 1 

hm < A + H^Pj,sh } = 1- 5.5) 

3=1 J 

Hence the proof of this theorem remains similar to the proof of Theorem l4.4i In 
the case A2 > A'+/u Sj=i Pj,sh the system is stable if Aj* < /x. In the other case 

Ai < A' the system is stable if A + A' + ijl ^ YliLi Y^jLi Pi,j + YjJ=i Pj,shj < myL. 
The conditions of the theorem are sufficient and not necessary, because the 
left-hand sides of (|5.2p . (|5.4p and (|5.5p contain the probability of inequalities, 
and the exact parameters of internal dedicated traffic as well as internal oppor- 
tunistic traffic are unknown. □ 

In order to formulate and prove a necessary and sufficient condition of stabil- 
ity for the above load-balanced network, we first need to improve the sufficient 
condition given by Theorem 15.11 For this purpose, rewrite (|5.2p as 



\ hm — = Qifipi j \ = 1, 

L -00 t — a > 



t — a 

where the value Qi satisfies the inequality < & < 1. The value Qi is the 
fraction of time when the server of the ith queue is busy. Then the case of 
Qi = 1 means that the server of the ith queue is busy almost always. 
Let us consider the system of inequalities 



Aj + A* YT=i QiPhj 



< M ; j = 1,2,... ,m. (5.6) 



The meaning of inequality (|5.6p is the following. The left-hand side contains 
the total sum of rates of dedicated traffic to the jth queue divided to the traffic 
parameter q*- of the jth queue. The total sum of rates of dedicated traffic of 
the jth queue consists of exogenous and internal arrivals to that jth queue, 
excluding the rates for joining the shortest queue customers. Since the rates 
associated with opportunistic traffic are excluded, there is the inequality '<' 
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between the left and right sides. Thus, if the jth queue is never shortest, then 
the sum of the rates of the left-hand side divided to Qj becomes equal to fi of 
the right-hand side. When the traffic parameter g* is greater than 1, the jth 
queue increases to infinity with probability 1. Therefore, in the sequel we only 
consider the case when g*- <1 for all j = 1, 2, . . . , m. In this case g* = Qj, and 
we therefore have 

m 

A i + f 1 ^2 8iPi 'i - Qi^i j = 1, 2, . . . , m. (5.7) 

i=i 

Let us now write a so-called balance equation, taking into account also joining 
the shortest queue customers. We have 

mm m 

A + A' + QiPij = fi^2gj(l-pj )a h)- (5-8) 

j=l i=l j=l 

Now, we are ready to prove the improved sufficient condition for the stability. 
This version is also based on a straightforward extension of Theorem 14.41 

Theorem 5.2. The load-balanced network is stable if there exists 

g* = max Qj, 

l<j<m 

satisfying the condition g* < 1, where the values Qj, j = 1,2, ... ,m, are defined 
by (1521) and (JE 



Proof. Let Aj = Xj + M^I=i QiPij ■> ^ 3* = ar § max i<j<m Aj, and let A = 
SjLi(Aj* — A?)* ^ n case ^ > A' + fiYljLi 8jPj,sh the j*-th queue is never 
shortest, and therefore, following the proof of Theorem 14.41 the system is stable 
if Aj* < fi. Therefore from (15.61) we have gj* < 1, and because the j*-th. queue 
is the longest queue, we have g* = gj* > Qj, j = 1,2, ... ,m. Therefore Qj < 1 
for all j = 1, 2, . . . , m is a sufficient condition of stability for this case. 

Let us now consider the opposite case, where A < A' + f^Y^jLi QjPj,sh- As 
in the proof of Theorem 14.41 in this case the arrival rate to all m queues is the 
same, and therefore Qi = Q2 = ■ ■ ■ = Qm- Thus, the only two cases are there as 
Qj < 1 or Qj = 1 for all j = 1, 2, . . . , m. In the case Qj < 1, the stability result 
is analogous to that of Theorem 14.41 since in this case from (|5,8p we obtain 

mm m 

A + A' + n ^2 Pi <i + V p i' sh < m/i - 
j=i i=i j=i 

The theorem is proved. □ 

Now in order to formulate and prove a necessary and sufficient condition for 
stability, let us consider the following linear programming problem in M m+1 : 

Minimize x m+ \ (5-9) 

subject to the restrictions: 

m 

A? + f J '^2 x iPi,j - XjVi j = 1 , 2 , ■ ■ ■ , m , (5-10) 
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mm m 

A + A' + ji } ] XjPij = fj,y)xj(l -Pj, s h), (5.11) 

3=1 »=1 3=1 

acj < aJm+l) i = 1>2, ... ,m. (5.12) 
Observe, that the restrictions (|5.10p and (|5.1ip correspond to (|5.7p and 
(|5.8p . where the values Qj are replaced with unknown Xj. The functional of 
(|5.9p and inequalities (|5.12p are associated with the condition of Theorem 15.21 
maxi<j< m Qj < 1. x m+ i is an additional variable; thus the linear programming 
(|5.9p - (|5.12p is a mini-max problem. That is, if the minimum of x m+ \ is achieved 
in some point xj^+i < 1> then all components of the vector . . . ,x^ +1 ) 

associated with this solution are less than 1, and there exists a solution of 
system (|5.7p and (|5.8p with qa < 1 for all j = 1, 2, . . . , m. Therefore in the fol- 
lowing the vector associated with solution of the problem (|5.9p - (|5.12p is denoted 
(qi, Q2, ■ ■ ■ , Q m )- Otherwise if x* m+l > 1, then we set Qj = 1, j = 1, 2, . . . , m. 

Next, denote Aq (t) + Ea\t) the dedicated arrival process. Its relation to 
the initial processes A a (t) and Da (t) is the following. Each arrival of the 
initial process A a (t) is forwarded to the queue j with probability pj, and each 
customer served in the queue i returns to the jth queue with probability pij. 

Then, the process A$ (t)+E a (t) is a sum of all arrivals of external and internal 
dedicated traffic, and 

p r r A^(t) + E^(t) » x 

P( — =A 4 = X j +^ eHHj} = 1, 

1=1 

where j = 1,2, ... ,m, are a solution of the linear programming given by 
(|5.9p - (l5.12p . Now let j* = argmaxi<j< m Aj. We have the following theorem. 

Theorem 5.3. Assume that the both 

lim P{AP(t)+EP(t)-DP(t)e^} = 0, (5.13) 

— oo 

and 

lim P{A a (t) + A' a (t) + E a (t) + E' a (t) - D a (t) E y} = 0, (5.14) 

a— > — oo 

/or any bounded set ,5? , where E a (t) = ]Cj=i Ea \t) is the point process associ- 
ated with all internal arrivals of dedicated traffic, E' a (t) is the point process as- 
sociated with all internal arrivals of opportunistic traffic, D a (t) = X)j==i D^\t). 
Then the load-balanced network is stable if and only if maxi<,< TO Qj < 1. 

Remark 5.4. Conditions (|5.13p and (|5.14p are verifiable conditions. As soon as 
the linear programming problem is solved and we know the vector of solution 

(f?ij f?2> • • • j Qm), the unknown processes E a (t) and E' a (t) as well as Ea\t) and 
E'Ji\t) can be easily modelled via derivative processes Da (t) (j = 1,2, . . . , m). 
Note also, that above conditions (|5.13p and (|5.14p are automatically fulfilled if 
maxi<j<„ Qj < 1. 

Remark 5.5. In the case of the network associated with the model T m the 
following additional comment is necessary. If the value j* is not unique, then 
condition (I5.13P should be assumed for all of these values j* . 
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6. Concluding remarks 

In this paper we established stability of different type joint-the-shortest-queue 
models including load-balanced networks. The statements of stability are es- 
tablished under quite general assumptions on arrival and departure processes 
by reduction to the corresponding models with autonomous service mechanism. 

Now we discuss how these results can be extended to the models of queues and 
networks allowing batch arrivals and batch departures. For this purpose, con- 
sider the queueing system with batch arrivals and departures and autonomous 
service. For this queueing system let <s/(t) denote arrival process and let 3>{t) 
departure process, both marked point processes. (All of the processes consid- 
ered in this section are assumed to start at zero.) For the sake of simplicity 
suppose that the marks of the point process £>(t) all are of the constant size 
c (c is a positive integer number), and therefore 3>{t) = cD{t). Then, the 
queue-length process Q{t) has the following representation (see [1]): 

Q(t) = *f(t)-J2 /\ Q(s _)> d£>( S ). 

It was shown in [1] that by using Skorokhod's reflection principle we arrive at 
equation 

Q{t)=[s/{t) - &{t)\ - inf[^(s) - £>(s)}, (6.1) 

s<t 

which is similar to that of the process with ordinary departures. The assump- 
tion, that the marks of departure process are a constant c, is specific and as- 
sociated with concrete models considered in [4|. Representation (|6.1|) remains 
in force in general, when a departure process is an arbitrary marked point pro- 
cess with mutually independent identically distributed marks. Representation 
(|6.ip is easily generalized to the case of JS-queue models. Specifically, for the 
queue-length process in the jth server of the model p m we have the similar 
equation 

- inf (s) + (t) - 9® (a)] , ^ 

s<t 

where s^'^\t) is the corresponding notation for an opportunistic traffic to the 
jth server of the JS-queue model (see ref. (|4.6p for comparison). Thus, the case 
of batch arrivals and departures is a direct extension of the case of ordinary 
arrivals and departures, and the conditions for stability are similar. 
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